Search results for " sound synthesis"

showing 6 items of 6 documents

Non-speech voice for sonic interaction: a catalogue

2016

This paper surveys the uses of non-speech voice as an interaction modality within sonic applications. Three main contexts of use have been identified: sound retrieval, sound synthesis and control, and sound design. An overview of different choices and techniques regarding the style of interaction, the selection of vocal features and their mapping to sound features or controls is here displayed. A comprehensive collection of examples instantiates the use of non-speech voice in actual tools for sonic interaction. It is pointed out that while voice-based techniques are already being used proficiently in sound retrieval and sound synthesis, their use in sound design is still at an exploratory p…

Computer scienceVoice - Sonic interaction - Information retrieval - Sound synthesis - Sound designSpeech recognitionSound design02 engineering and technologyExploratory phase020204 information systemsSonic interaction design0202 electrical engineering electronic engineering information engineeringSelection (linguistics)Information retrieval0501 psychology and cognitive sciences050107 human factorsSound (geography)Sonic interactiongeographyModality (human–computer interaction)geography.geographical_feature_categoryInformation retrieval; Sonic interaction; Sound design; Sound synthesis; Voice; Signal Processing; Human-Computer InteractionSettore INF/01 - Informatica05 social sciencesSound synthesiSound designHuman-Computer InteractionSignal ProcessingVoice
researchProduct

Multisensory integration of drumming actions: musical expertise affects perceived audiovisual asynchrony

2009

We investigated the effect of musical expertise on sensitivity to asynchrony for drumming point-light displays, which varied in their physical characteristics (Experiment 1) or in their degree of audiovisual congruency (Experiment 2). In Experiment 1, 21 repetitions of three tempos x three accents x nine audiovisual delays were presented to four jazz drummers and four novices. In Experiment 2, ten repetitions of two audiovisual incongruency conditions x nine audiovisual delays were presented to 13 drummers and 13 novices. Participants gave forced-choice judgments of audiovisual synchrony. The results of Experiment 1 show an enhancement in experts' ability to detect asynchrony, especially fo…

Malesound synthesisSignal Detection PsychologicalSound SpectrographyTime FactorsMusical expertiseMotion PerceptionNormal DistributionVideo RecordingDrumming actionaudiovisual perceptionPsychophysicsmedia_commonSettore INF/01 - InformaticaGeneral Neuroscienceinteractive simulationAuditory PerceptionLinear ModelEducational StatusSynchrony perceptionaudiovisual perception; interactive simulation; sound synthesisPsychologyHumanCognitive psychologyAdultAuditory perceptionSpeech perceptionTime Factormedia_common.quotation_subjectAudiovisual integrationStimulus (physiology)JudgmentYoung AdultPerceptionPsychophysicsHumansMotion perceptionAudiovisual congruencyDrumming actionsAnalysis of VarianceCommunicationbusiness.industryMultisensory integrationSynchrony perception; Audiovisual integration; Audiovisual congruency; Drumming actions; Musical expertiseEducational StatuAcoustic StimulationPsychophysicLinear ModelsbusinessMusicPhotic StimulationBiological motionExperimental Brain Research
researchProduct

Embodied sound design

2018

Abstract Embodied sound design is a process of sound creation that involves the designer’s vocal apparatus and gestures. The possibilities of vocal sketching were investigated by means of an art installation. An artist–designer interpreted several vocal self-portraits and rendered the corresponding synthetic sketches by using physics-based and concatenative sound synthesis. Both synthesis techniques afforded a broad range of artificial sound objects, from concrete to abstract, all derived from natural vocalisations. The vocal-to-synthetic transformation process was then automated in SEeD, a tool allowing to set and play interactively with physics- or corpus-based sound models. The voice-dri…

Range (music)sound synthesisProcess (engineering)Sound designHuman Factors and Ergonomicsvocal sketchingsonic interaction design01 natural sciences050105 experimental psychologyEducationHuman–computer interaction0103 physical sciencesSettore ICAR/13 - Disegno IndustrialeNatural (music)0501 psychology and cognitive sciencesSet (psychology)010301 acousticsSound (geography)embodimentSettore ING-INF/05 - Sistemi Di Elaborazione Delle Informazionigeographygeography.geographical_feature_categorySettore INF/01 - Informatica05 social sciencesGeneral EngineeringSound designHuman-Computer InteractionHardware and ArchitectureEmbodied cognitionSound design; embodiment; vocal sketching; sound synthesisSoftwareGesture
researchProduct

The Sound Design Toolkit

2017

The Sound Design Toolkit is a collection of physically informed sound synthesis models, specifically designed for practice and research in Sonic Interaction Design. The collection is based on a hierarchical, perceptually founded taxonomy of everyday sound events, and implemented by procedural audio algorithms which emphasize the role of sound as a process rather than a product. The models are intuitive to control – and the resulting sounds easy to predict – as they rely on basic everyday listening experience. Physical descriptions of sound events are intentionally simplified to emphasize the most perceptually relevant timbral features, and to reduce computational requirements as well. Keywo…

Settore ING-INF/05 - Sistemi Di Elaborazione Delle Informazionilcsh:Computer softwaresound synthesisound synthesisSettore INF/01 - InformaticaComputer scienceSound designSpeech recognition05 social sciences020207 software engineering02 engineering and technologysonic interaction design050105 experimental psychologyComputer Science ApplicationsSonic interaction design; sound synthesis; procedural audiolcsh:QA76.75-76.765Human–computer interactionSonic interaction design0202 electrical engineering electronic engineering information engineeringprocedural audio0501 psychology and cognitive sciencesActive listeningsonic interaction design; sound synthesis; procedural audioSoftware
researchProduct

Reverberation still in business: Thickening and propagating micro-textures in physics-based sound modeling

2015

Artificial reverberation is usually introduced, as a digital audio effect, to give a sense of enclosing architectural space. In this paper we argue about the effectiveness and usefulness of diffusive reverberators in physically-inspired sound synthesis. Examples are given for the synthesis of textural sounds, as they emerge from solid mechanical interactions, as well as from aerodynamic and liquid phenomena.

sound synthesissound modelingSettore INF/01 - Informaticareverberationreverberation sound synthesis sound modelingartificial reverberation
researchProduct

Sketching sonic interactions by imitation-driven sound synthesis

2016

Sketching is at the core of every design activity. In visual design, pencil and paper are the preferred tools to produce sketches for their simplicity and immediacy. Analogue tools for sonic sketching do not exist yet, although voice and gesture are embodied abilities commonly exploited to communicate sound concepts. The EU project SkAT-VG aims to support vocal sketching with computeraided technologies that can be easily accessed, understood and controlled through vocal and gestural imitations. This imitation-driven sound synthesis approach is meant to overcome the ephemerality and timbral limitations of human voice and gesture, allowing to produce more refined sonic sketches and to think a…

sound synthesisvocal imitationsSettore INF/01 - Informaticasound design toolsSettore ICAR/13 - Disegno Industrialevocal sketching sound synthesis sound design toolsvocal sketchingsonic interaction design
researchProduct